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TECHNICAL FIELD 



The present invention generally relates to Internet Protocol (IP) telephony 
and, more specifically, relates to a method and system for automatic proxy 
server workload shifting for load balancing. 



IP telephony is a collection of technologies that emulates and extends 
today's circuit-switched telecommunications services to operate on packet- 
switched data networks based on the Internet Protocol (IP) IP telephony 
encompasses the terms "Internet Telephony", "voice-over-IP" (VoIP), "video- 

15 over-IP", and "fax-over-IP", and extends those capabilities even further to 
include new telecommunications applications made possible by the 
convergence of voice, video and data. "Voice-over-IP" (VoIP) technology 
enables the real-time transmission of voice signals as packetized data over "IP 
networks" that employ the Transmission Control Protocol (TCP), Real-Time 

20 Transport Protocol (RTP), User Datagram Protocol (UDP), and Internet Protocol 
(IP) suite, for example. 

A conventional Public Switched Telephone Network (PSTN) provides its 
users with dedicated, end-to-end circuit connections for the duration of each 
call. Based on the calling and called parties' numbers, circuits are reserved 

25 among an originating switch, any tandem switches along the route between 
the two ends of the call, and a terminating switch. Signaling between these 
PSTN switches supports basic call setup, call management, and call teardown 
as well as querying of databases to support advanced services such as local 
number portability, mobile subscriber authentication and roaming, virtual private 

30 networking, and toll-free service. 

The conventional PSTN has served voice traffic well over the last 100 
years, but its success has been paralleled by a rise of separate networks to 
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support data traffic. These separate networks include, for example, the World- 
Wide Web which is commonly referred to as the Internet, an Intranet, a wide- 
area network (WAN), a local area network (LAN), an ATM, a T1 network, an 
E1 network, an Ethernet, a microwave network, a satellite network or the like, 
5 or a combination thereof. Clearly, use of distinct networks for voice and data 
represents an additional burden to service providers and an additional cost to 
consumers. As more and more PSTN traffic becomes data-oriented, however, 
the trend toward voice and data network convergence becomes stronger and 
stronger. Service providers, Internet service providers, and manufacturers of 

10 switching, transmission, and customer premises equipment are all participating 
in a significant shift of the telecommunications industry toward combined 
voice/video/data networking using IP. 

The shift to IP telephony promises better efficiencies in the transport of 
voice and data, and, as a result, lower telecommunications costs to end users. 

1 5 Moreover, as IP telephony evolves, it will be able to match all the features of 
voice communications currently supported by the PSTN. Interoperability 
among the IP telephony products of different vendors is the first major hurdle 
to overcome. The real promise of IP telephony, however, will be realized with 
the next wave of advanced services that will begin to surpass the capabilities 

20 of the PSTN. 

There are, however, some drawbacks associated with existing IP 
telephony systems. For example, in VoIP systems, most VoIP clients need to 
connect to a VoIP proxy server in order to complete a call. After the VoIP 
client connects to a VoIP proxy server, the overall system can provide services 

25 for the VoIP client. In conventional systems, since the VoIP proxy server is 

responsible for tracking the status of each connected VoIP client, on going calls 
and other services, the VoIP proxy server may be overloaded if too many 
clients attempt to connect to it. This may reduce the quality of service. This 
also increases the workload on the designated VoIP proxy server, even though 

30 other VoIP proxy servers in the VoIP system may have much lower workloads. 
This occurs even if the VoIP client connects to VoIP proxy servers connected in 
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a conventional round robin manner. Round robin connection does not 
guarantee that the workload will be equally distributed among the VoIP proxy 
servers. In many instances, the VoIP client lacks information on the workload 
of each VoIP proxy server and is unable to connect to a less loaded VoIP proxy 
5 server. One attempted solution is to configure multiple proxy servers to receive 
a request to connect from a VoIP client. One of the proxy servers is configured 
as the primary proxy server. If the VoIP client cannot connect to the primary 
proxy server, then the VoIP client transmits a request to a secondary VoIP 
proxy server. The VoIP client may be configured to attempt to connect to each 

10 of the VoIP proxy servers in the VoIP proxy server group in a predefined 
sequence by directly transmitting the request to connect to each one. 
Alternatively, service providers provide a list of available servers and let the 
user try and pick a less busy one. This places the burden on the user who 
must manually select a VoIP proxy server from the list and attempt to connect 

1 5 to the newly selected VoIP proxy server. In this scenario, the user usually 

lacks information on the workload level of the VoIP proxy servers and relies on 
"luck" to select a less loaded VoIP proxy server with which to attempt to 
connect. 

Therefore, there exists a strong need in the art for a system and method 
20 which automatically identifies and utilizes the VoIP proxy server with a lower 
workload. Such a system and method would provide the identity of the VoIP 
proxy server with the lower workload to the VoIP client in order to more 
efficiently complete the call. 



25 SUMMARY OF THE INVENTION 

According to one aspect of the invention, the invention is a Voice-over- 
Internet Protocol (VoIP) system. The VoIP system includes a network including at 
least two VoIP proxy servers configured to shift workload automatically and to allow 
voice data to be transmitted and received over the network and at least one VoIP 
30 client operatively is coupled to the network to transmit and receive voice data over 
the network. 



3 



INMEP0103US 



BRIEF DESCRIPTION OF DRAWINGS 

These and further features of the present invention will be apparent with 
reference to the following description and drawings, wherein: 
5 FIG. 1 is a system level diagram of a VoIP system including a plurality of 

VoIP proxy servers configured to shift workload automatically according to an 
embodiment of the present invention; 

FIG. 2 is a detailed schematic flow diagram representing a VoIP client 
connecting to the VoIP system using the plurality of VoIP proxy servers 
10 configured to shift workload automatically in an embodiment of the present 
invention; 

FIG. 3 is a flow diagram of a method for employing the plurality of VoIP 
proxy servers configured to shift workload automatically according to the 
present invention; 

1 5 FIG. 4 is a flow diagram of a method for automatically identifying the 

VoIP proxy server with a lower workload according to an embodiment of the 

present invention; and 

FIG. 5 is a flow diagram of a method for requesting the plurality of VoIP 

proxy servers configured to shift workload automatically to connect to a VoIP 
20 proxy server with a lower workload according an embodiment of the present 

invention. 

DISCLOSURE OF INVENTION 

To illustrate the present invention in a clear and concise manner, the 
25 drawings may not necessarily be to scale and certain features may be shown in 
a partial schematic format. 

The present invention is a VoIP system including a plurality of VoIP 
proxy servers configured to balance workload by automatically shifting to a 
next predefined VoIP proxy server if the current VoIP proxy server has a 
30 workload above a predefined threshold. In one embodiment, a VoIP client 

communicates with a primary VoIP proxy server before connecting to one of 
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the VoIP proxy servers, i.e., the Vo!P proxy server with a workload below a 
predefined threshold. Further, the invention includes a method for determining 
and identifying the VoIP proxy server with the lower workload based on a 
predefined workload threshold. Further, the method includes providing the 
5 identity of the VoIP proxy server to the VoIP client so that the VoIP client may 
connect. 

The primary VoIP proxy server is the portal through which the VoIP client 
connects with the plurality of VoIP proxy servers. When the primary VoIP 
proxy server receives a client request to connect from a VoIP client wanting to 

10 connect to the VoIP system, the plurality of VoIP proxy servers configured to 
shift workload automatically determine and identify the VoIP proxy server with 
the lower workload by automatically forwarding the client request to connect 
to one of the VoIP proxy servers whose workload is below a predefined 
threshold. This may be the primary VoIP proxy server or it may be a VoIP 

1 5 proxy server included in a predefined group of VoIP proxy servers with a 

specific predefined priority relationship or hierarchy between the VoIP proxy 
servers of the group. In response to the client request to connect, the primary 
VoIP proxy server provides the identity of the VoIP proxy server able to handle 
the call to the VoIP client. The VoIP client then connects to the identified VoIP 

20 proxy server and accesses the VoIP system. The VoIP client connects to the 
identified VoIP proxy server for the duration of the call. Thus, the workload is 
balanced among the VoIP proxy servers. 

Referring initially to FIG. 1, an embodiment of a VoIP system, generally 
designated as 10, is shown. In the VoIP system 10, is a digital data network 

25 over which digitized voice signals are transmitted as a stream of packets. The 
underlying digital data network may be an IP network 12, for example, a 
proprietary network, a network of leased facilities, the Internet, an Intranet, a 
WAN, a LAN, a virtual private network (VPN), or the like, or a combination 
thereof. Within the IP network 1 2 are a plurality of VoIP proxy servers #1 

30 through #N, for example. The plurality of VoIP proxy servers are coupled 

together, for example, via conventional network routing or other means known 
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by those with ordinary skill in the art. One of the plurality of VoIP proxy 
servers is configured as a primary VoIP proxy server 14. The primary VoIP 
proxy server 14 is the VoIP proxy server designated as the portal through 
which a VoIP client accesses the VoIP system 10. The particular process by 
5 which a VoIP proxy server is identified to a VoIP client requesting to connect to 
the VoIP system is transparent to the VoIP client. The operation of the 
plurality of VoIP proxy servers, e.g., servers #1 through #N, in relation with a 
transmitting or calling VoIP client and a receiving VoIP client, will be further 
explained below with reference to FIGS. 2-5. It should be understood that 

10 included in the IP network 12 will be other network devices to complete the 
network such as gateways, routers, switches, etc. (not shown). 

A plurality of conventional analog phones 1 6 may be coupled to the IP 
network 1 2 via a local PSTN gateway 22. The plurality of the analog phones 
1 6 may be part of a local PSTN 20. Thus, the plurality of the analog phones 

15 16 may access the VoIP system 10 locally using known techniques. 

Additionally, various "Session Initiation Protocol" (SIP) phones 18 may 
be coupled to the IP network 1 2 via a SIP gateway 1 9, for example. A 
plurality of IP phones 26 and/or computers 28, for example, may also be 
coupled to the IP network 12 via various media gateways 24 and/or various 

20 routers 30. Additionally, various H.323 phones 32 may be coupled to the IP 
network 12 via an H.323 gateway 34, for example. 

Each computer 28 may have, for example, a pair of speakers and a 
microphone (not shown) or may have a headset with a microphone (not 
shown). Alternatively, a computer video camera with a microphone may be 

25 coupled to the computer 28 (not shown). The computer 28 may be a personal 
computer (PC) configured as a multimedia computer, a mobile computing 
device such as a laptop computer or the like. The computer 28 may execute 
logic, e.g., software, in order to place a VoIP call. 

As will be appreciated, the analog phones 16, the SIP phones 18, the IP 

30 phones 26, the computers 28, the H.323 phones 32, etc., via their respective 
gateways or routers, represent VoIP clients within the VoIP system 10. The 
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VoIP clients are each capable of making and receiving telephone calls via the IP 
network 1 2 by transmitting and receiving digital voice data packets 
therebetween. The actual procedures and protocols for exchanging such data 
employs conventional VoIP techniques except as otherwise described herein. 
5 Thus, the description herein focuses primarily on the inventive aspects. 

Next, the general operation of the VoIP system 10 will be described. As 
previously mentioned, the VoIP system 10 utilizes VoIP technology to allow 
voice calls to be originated and terminated on various types of platforms over 
the IP network 1 2. For example, the analog phones 1 6 supported by a 

10 conventional PSTN can place and receive calls over the IP network 12. 

Alternatively, a SIP phone 18, an IP phone 26 or a H.323 phone 32 can place a 
call to an analog phone 1 6 on a local PSTN. The local PSTN may be in another 
city, state or country. Further still, a computer 28 could call another computer 
28, a SIP phone 18, an IP phone 26, an analog phone 16, a cell phone (not 

1 5 shown), a satellite phone (not shown) or the like, or a combination thereof. 

In yet another alternative, any of the aforementioned VoIP clients may 
place a call to a VoIP proxy server which hosts special services. For example, 
a VoIP proxy server may host voice mail or video mail. The VoIP client can 
connect to the VoIP proxy server hosting the special services to retrieve voice 

20 or video mail in an otherwise conventional manner. 

The VoIP technology translates a destination telephone number into a 
data network address ("IP address") associated with a corresponding 
terminating gateway nearest to the destination number. Using an appropriate 
protocol and packet transmission over the IP network 1 2, the terminating 

25 gateway will transmit the call directly to the VoIP client or initiate a call to the 
destination phone number over the local PSTN 20 at the receiving destination 
to establish completely end-to-end two-way communications. Despite the 
additional connections required, the overall call setup time is not significantly 
longer than with a call fully supported by a conventional PSTN. 

30 In general, in order to complete a call by accessing the VoIP proxy 

servers on the IP network 1 2, a VoIP client establishes a connection with the 
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primary VoIP proxy server 14. Next, the VoIP client requests to connect with 
the primary VoIP proxy server 14 in order to complete the call. The primary 
VoIP proxy server 14 determines whether its workload is below a predefined 
threshold and therefore can handle the call. If the primary VoIP proxy server 
5 1 4 is able to handle the call, then the primary VoIP proxy server 1 4 responds to 
the client request to connect with its identity, e.g., its IP address. Upon 
receiving the response, the VoIP client proceeds to connect to the primary VoIP 
proxy server 14 to complete the call. 

However, if the workload of the primary VoIP proxy server 14 is above 

1 0 the predefined threshold, then the primary VoIP proxy server 1 4 is considered 
unable to handle the call. In this case, the primary VoIP proxy server 14 
automatically forwards the client request to connect to a next VoIP proxy 
server in accordance with a predefined sequence. The next VoIP proxy server 
in the predefined sequence determines whether its workload is below the 

1 5 predefined threshold and therefore can handle the call. The above process of 
automatically forwarding the VoIP client's request to connect to the next VoIP 
proxy server in the sequence continues until the request is received by a VoIP 
proxy server in the sequence whose workload is determined to be below the 
predefined threshold and therefore is capable of handling the call. The VoIP 

20 proxy server thus able to handle the call generates and transmits a response to 
the previous VoIP proxy server in the sequence, i.e., the VoIP proxy server 
which forwarded the request to connect. The response includes the identity of 
that particular VoIP proxy server which is able to handle the call. Such 
identification may be by an IP address, for example. Similarly, the response is 

25 forwarded by any other intervening VoIP proxy servers in the sequence back to 
the primary VoIP proxy server 14. 

Next, the primary VoIP proxy server 14 generates a response to the 
client request to connect and transmits the response to the requesting VoIP 
client. Again, the response includes the identity (e.g., IP address) of the VoIP 

30 proxy server in the sequence which identified itself as able to handle the call. 
Once the response is received by the VoIP client, the VoIP client connects to 
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the VoIP proxy server identified in order to establish the ca!! in an otherwise 
conventional manner. 

Thus, the VoIP client wishing to make a call via the IP network 1 2 first 
requests to connect to the primary VoIP proxy server 14 (i.e., VoIP proxy 
5 server #1 ). If the primary VoIP proxy server 1 4 is unable to handle the call, 
then the primary VoIP proxy server proceeds to forward the request in order to 
the VoIP proxy servers #2 through #N based on a predefined hierarchy or the 
like in order to identify a VoIP proxy server experiencing a lower workload. The 
VoIP client then establishes the call through that particular VoIP proxy server. 

10 In this manner, the present invention helps to avoid one or more VoIP proxy 
servers shouldering the majority of the workload while other of the VoIP proxy 
servers are underutilized at any given moment in time. This way, more 
optimum network connections may be established for each call, thereby 
reducing latency time, etc. 

1 5 Additionally, the VoIP client only needs to connect initially to the primary 

VoIP proxy server 14. The automatic workload shifting process takes place 
within the group of VoIP proxy servers and may be totally transparent to the 
VoIP client. This reduces back and forth traffic between the VoIP proxy 
servers and the VoIP client if the same process was done individually by the 

20 VoIP client. Further, the method also helps to reduce the number of server 
addresses needed to be exposed to public. This is a significant help when a 
service provider needs to relocate or deploy a new VoIP proxy server to the 
system. 

In the VoIP system 10, voice signals are digitized and transmitted as a 
25 stream of packets over the IP network 12. The IP network 12 allows each 
packet to find independently the most efficient path to the intended 
destination, thereby best using the network resources at any given instant. 
The packets associated with a single source may thus take many different 
paths to the destination in traversing the IP network 1 2, arriving with different 
30 end-to-end delays, arriving out of sequence, or possibly not arriving at all. At 
the destination, however, the packets are re-assembled and converted back 
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into the original voice signal. VoIP technology insures proper reconstruction of 
the voice signals, compensating for echoes made audible due to the end-to-end 
delay, for jitter, and for dropped packets, etc. 

Turning now to FIG. 2, the IP network 12 is represented with a 
5 representative VoIP client 36 (hereinafter client 36) attempting to connect to 
the primary VoIP proxy server 14 (i.e., proxy server #1) in order to complete a 
VoIP call in accordance with the invention. The client 36 may be any device 
capable of transmitting and receiving voice or video data over a VoIP system 
10. For example, the client 36 may take the form of one of the analog phones 
10 16, the SIP phones 18, the IP phones 26, the computers 28, etc., which 

connect to the IP network 1 2 via its respective gateway or router. The steps 
of the call connection process will now be further explained with reference to 
FIGS. 3-5. 

Referring to FIG. 3, the overall process is shown for identifying a VoIP 
1 5 proxy server in the VoIP system 10 in accordance with the present invention. 
In step 54, the primary VoIP proxy server 14 receives a request from client 36 
to connect to the primary VoIP proxy server 14 in order to place a VoIP call. 
The client request to connect is represented by network connection line 38 in 
FIG. 2. 

20 Next in step 56, the primary VoIP proxy server 14 determines whether 

its workload is below a predefined threshold and therefore can handle the call. 
If the primary VoIP proxy server 14 is able to handle the call, then the primary 
VoIP proxy server 14 responds to the client request to connect with a response 
including its identity. Upon receiving the response, the client 36 proceeds to 

25 connect to the primary VoIP proxy server 14 to complete the call. The 

particular manner in which the predefined workload threshold is determined and 
evaluated can be based on any of a variety of predetermined criteria. The 
present invention is not intended to be limited necessarily to any particular 
criteria for establishing or evaluating the predefined workload threshold. 

30 However, if the workload of the primary VoIP proxy server 1 4 is above 

the predefined threshold, then the primary VoIP proxy server 14 considers itself 
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unable to handle the call. In this instance, the primary VoIP proxy server 14 is 
configured to forward the client request to connect automatically to the next 
VoIP proxy server in the predefined sequence (e.g., proxy server #2). The next 
VoIP proxy server determines whether its workload is below the predefined 
5 threshold and therefore is able to handle the call. 

If the workload of such next VoIP proxy server, e.g., proxy server #2, is 
above the predefined threshold, then the VoIP proxy server considers itself 
unable to handle the call. The VoIP proxy server, i.e., proxy server #2, is thus 
configured to forward the client request to connect automatically to the next 

10 VoIP proxy server in the predefined sequence, e.g., proxy server #3. This 
server now becomes the next VoIP proxy server in the sequence which 
processes the request to connect. 

Such current VoIP proxy server (e.g., proxy server #3) then determines 
whether its workload is below the predefined threshold and therefore is able to 

1 5 handle the call. For this example, the VoIP proxy server #3 determines its 
workload is below the predefined threshold and therefore is able to handle a 
call. The VoIP proxy server #3 then generates and transmits a response to the 
request to connect to the previous VoIP proxy server in the sequence, i.e., the 
VoIP proxy server which forwarded the request to connect. The response 

20 includes the identity of that particular VoIP proxy server which is able to handle 
the call. Similarly, the response is forwarded by any other intervening VoIP 
proxy servers in the sequence back to the primary VoIP proxy server 14. 

The forwarding of the request by the primary VoIP proxy server 14 to a 
next VoIP proxy server in the predefined sequence, i.e., proxy server #2, and a 

25 subsequent VoIP proxy server, i.e., proxy server #3, are represented by 

network connection lines 40 and 42, respectively, in FIG. 2. The response by 
the VoIP proxy server able to handle the call, i.e., proxy server #3, to the 
previous VoIP proxy server in the sequence, i.e., proxy server #2, and the 
forwarding of the response to the primary proxy server 14 are represented by 

30 network connection lines 44 and 46, respectively, in FIG. 2. It should be 
understood that the above process of automatically forwarding the client 
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request to connect to the next VoIP proxy server in the predefined sequence 
may continue until the workload of a VoIP proxy server is determined to be 
below the predefined threshold and therefore capable of handling the call. 

Next in step 58, the primary VoIP proxy server 14 responds to the client 
5 request to connect from the client 36 by providing the identity of the VoIP 
proxy server, i.e., proxy server #3, identified as able to handle the call, i.e., 
having a lower workload. The response, by the primary VoIP proxy server 14, 
that provides the identity of the VoIP proxy server to the client 36 is 
represented by network connection line 48 in FIG. 2. The identity of the VoIP 

10 proxy server may be, for example, an IP address or the like which the primary 
VoIP proxy server 14 provides to the client 36. 

Next in step 60, the client 36 connects to the VoIP proxy server 
identified as able to handle the call in order to complete the VoIP call in an 
otherwise conventional fashion using known protocols, etc. In FIG. 2, VoIP 

1 5 proxy server #3 represents the VoIP proxy server identified as having the 

workload below the predefined threshold. The connection of client 36 to the 
VoIP proxy server #3 is represented by network connection line 50 in FIG. 2. 

Now referring to FIG. 4, the specific steps carried out by the plurality of 
VoIP proxy servers configured for identifying the VoIP proxy server able to 

20 handle a call, e.g., the first VoIP proxy server in the predefined sequence with a 
workload below the predefined threshold will be described. In step 62, the 
primary VoIP proxy server 14 is configured to wait for a client request to 
connect to be received from the client 36. 

Next in step 64, the primary VoIP proxy server 14 determines whether it 

25 has received a client request. If "no", then the primary VoIP proxy server 14 
returns to step 62 to continue to wait for a client request to connect to be 
received. The return to step 62 is represented by line 66. However, if the 
answer is "yes", then the primary VoIP proxy server 14 proceeds to determine 
its ability to handle a call in step 68. 

30 More specifically, in step 68 the primary VoIP proxy server 14 

determines whether its workload is below a predefined threshold and therefore 
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is able to handle the call. The particular manner in which the workload level is 
determined can be based on any of a variety of predetermined criteria. The 
present invention is not intended to be limited necessarily to any particular 
criteria for establishing the workload level. 
5 If the workload of the primary VoIP proxy server 14 is not over the 

predefined threshold, then the primary VoIP proxy server 14 considers itself 
able to handle a call and continues to complete the call setup process in step 
70. 

For example, the primary VoIP proxy server 14 responds to the client 
10 request to connect with its IP address and acknowledgement to connect, for 
example. Upon receiving the response, the client 36 proceeds to connect to 
the primary VoIP proxy server 14 to complete the call in an otherwise 
conventional manner. However, if the workload of the primary VoIP proxy 
server 14, i.e., server #1 , is over the predefined threshold, then the primary 
I 1 5 VoIP proxy server 1 4 considers itself unable to handle the call and proceeds to 
step 72. 

In step 72, since the workload of the primary VoIP proxy server 14 is 
over the predefined threshold, the primary VoIP proxy server 14, e.g., server 
#1 , is configured to forward the client request to connect automatically to the 

20 next VoIP proxy server in the predefined sequence. The forwarding of the 

client request to connect to the next predefined VoIP proxy server, i.e., server 
#2, is represented by network connection line 40 in FIG. 2. 

Next in step 74, the next VoIP proxy server, i.e., server #2, determines 
whether its workload is below a predefined threshold and therefore is able to 

25 handle the call. If the workload of the next VoIP proxy server, e.g., proxy 
server #2, is above the predefined threshold, then the current VoIP proxy 
server considers itself unable to handle the call and proceeds to step 82. In 
step 82, the next VoIP proxy server determines whether it is the last VoIP 
proxy server in the predefined sequence. 

30 If the answer is "no", the current VoIP proxy server returns to step 72 

and forwards the client request to connect to the next VoIP proxy server in the 
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predefined sequence, e.g., server #3. The forwarding of the client request to 
connect to the next VoIP proxy server, i.e., server #3, is represented by 
network connection line 42 in FIG. 2. 

The process loops through steps 72, 74 and 82 until the workload of a 
5 VoIP proxy server is determined to be below the predefined threshold and 

therefore able to handle the call, i.e., the answer is "no" in step 74 or the VoIP 
proxy server determines its the last VoIP proxy server in the predefined 
sequence in step 82. In this exemplary scenario, proxy server # 3 determines 
it is below the predefined threshold and has the workload capacity to handle 
10 the call. 

Referring now to step 76, the particular VoIP proxy server determined to 
j:j be able to handle the call, e.g., proxy server #3, responds to the client request 
to connect by transmitting a response to the previous predefined VoIP proxy 
server in the sequence, i.e., server #2. Server #2 forwards the response to the 
gj 1 5 primary VoIP proxy server 14. The response by server #3 to server #2 is 
H represented by network connection line 44 in FIG. 2. The forwarding of the 
M response by server #2 to the primary VoIP proxy server 14 is represented by 
[[j network connection line 46 also in FIG. 2. 

% Nex t 'n step 78, the primary VoIP proxy server 1 4 responds to the client 

M20 request to connect from the client 36 by providing the identity of the VoIP 

proxy server currently able to handle the call, i.e., having a workload below the 
predefined threshold. The response by the primary VoIP proxy server 14 that 
provides the identity of the VoIP proxy server to the client 36 is represented by 
network connection line 48 in FIG. 2. The identity of the VoIP proxy server 
25 may be, for example, an IP address or the like which the primary VoIP proxy 
server 14 provides to the client 36. 

Next in step 80, the client 36 connects to the VoIP proxy server 
identified as able to handle the call, i.e., having the workload below the 
predefined threshold using known network protocols, etc. For example, in FIG. 
30 2, VoIP proxy server #3 represents the VoIP proxy server identified as having 
the workload below the predefined threshold. Client 36 connects to the VoIP 
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proxy server #3 via the network connection line 50 in order to complete the 
VoIP call in otherwise conventional fashion. 

Referring again to step 82, if the current VoIP proxy server is the last 
VoIP proxy server in the predefined sequence and its workload is over the 
5 predefined threshold, all the VoIP proxy servers are determined to be too busy 
to handle another call. The system proceeds to step 84 in which the client 
request to connect is forwarded back to the primary VoIP proxy server 14. The 
forwarding back of the client request to connect to the primary VoIP proxy 
server 14 is represented by network connection line 52 in FIG. 2. Next in step 

10 86, the primary VoIP proxy server 14 replies to the VoIP client that all VoIP 
proxy servers in the VoIP system 10 are too busy to provide service. In this 
case, the user must try again later. 

Thus, the method describes the relationship of the VoIP proxy servers 
including the VoIP proxy server group and the priority or sibling sequence 

1 5 between the VoIP proxy servers that belong to the same VoIP proxy server 
group. The method also discloses a method to determine the capability of a 
VoIP proxy server receiving a client request to connect to handle a call based 
on workload. Further, a sequence of protocols that forwards that request to a 
subsequent VoIP proxy server and determines if the subsequent VoIP proxy 

20 server will be able to respond to the client request to connect are also 

disclosed. Additionally, the method may include a means for terminating the 
client request to connect based on a present limitation to prevent an infinite 
loop. 

Now referring to FIG. 5, the steps carried out by the VoIP client making 
25 the call and requesting to connect to the primary VoIP proxy server 14 will be 
described. In step 88, a user of the VoIP system 10 initiates a call on the VoIP 
system via a VoIP client (e.g., the analog phones 16, the SIP phones 18, the IP 
phones 26, etc.). The user may, for example, pick up the receiver of the IP 
phone 26. Alternatively, the user may execute a VoIP program on the VoIP 
30 compatible computer 28. Further still, the user may pick up a receiver of the 
analog phone 1 6. 
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In step 90, the VoIP client transmits the client request to connect to the 
primary VoIP proxy server 14 (represented by network connection line 38 in 
FIG. 2). As previously described, such client request to connect asks the 
primary VoIP proxy server 14 to connect in order to make a call. 

Next in step 92, the client 36 receives a packet from the primary VoIP 
proxy server 1 4 containing the response to the client request to connect 
including the identity of the VoIP proxy server able to handle the call or a 
message indicating all the VoIP proxy servers are currently busy and unable to 
handle a call. In step 94, if an identity of a VoIP proxy server is received, the 
client 36 then proceeds to connect with the identified VoIP proxy server as 
represented by line 50 (FIG. 2) in order to establish the call in an otherwise 
conventional manner. Otherwise, the user may try again later. 

It will further be appreciated that the VoIP system 10 may alternatively 
have configurations other than the configurations shown in FIG. 1 . Thus, there 
has been disclosed a system and method of workload balancing by 
automatically shifting the workload to the VoIP proxy server able to handle a 
call, and providing such identity to a VoIP client so the VoIP client may connect 
to the VoIP system 10 in order to make a VoIP call. This method permits the 
more efficient use of the VoIP proxy servers by balancing the workload among 
the VoIP proxy servers more efficiently. 

Additionally, although the flow charts of FIGS. 3-5 show a specific order 
of execution, it is understood that the order of execution may differ from that 
which is depicted. For example, the order of execution of two or more blocks 
may be scrambled relative to the order shown. Also, two or more blocks 
shown in succession in FIGS. 3-5 may be executed concurrently or with partial 
concurrence. 

It will further be appreciated that each of the respective devices 
described herein is programmed via conventional computer programming 
techniques to execute machine-readable code in order to carry out the 
operations described herein. Such programming may be easily performed by 
those having ordinary skill in the art of computer programming and IP 
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technology based on the disclosure herein. Accordingly, the particular details 
of such programming code have been omitted for the sake of brevity. 

Although particular embodiments of the invention have been described ii 
detail, it is understood that the invention is not limited correspondingly in 
scope, but includes all changes, modifications and equivalents coming within 
the spirit and terms of the claims appended hereto. 
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